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Abstract 

Adaptive  digital  filters  are  I wing  used  and  proposed  for 
various  applications.  The  adaptive  recursive  filter  by 
Feintuch^rfls  an  example.  A stability  triangle  is  developed 
analytically  for  this  nonlinear  adaptive  recursive  filter  using 
a frozen-time  viewpoint.  Thero  are  reasons  to  believe  that 
the  average  stability  triangle  Is  correlated  to  the  true 
stability  region  for  all  modes  of  operation.  Computer  simu- 
lation of  two  cases  of  the  adaptive  filter  in  the  coefficient 
evaluation  mode  shows  that  the  stability  triangle  predicts  the 
stable  region  with  reasonable  accuracy  for  the  cases 
considered.  . 


X 1. 


introduction 


advantage  of  freezing  time  is  the  ease  in  which  results  about 
a nonlinear  filter  can  bo  obtained.  The  disadvantage  is  that 
the  stability  criteria  will  not  Ite  complete.  Rut  in  dealing 
with  nonlinear  equations,  a partial  solution  which  provides  a 
starting  point  for  a detailed  analysis  is  much  better  than  no 
solution. 

Assume  that  y(n{))  and  «^(n0)  have  just  been  computed 
using  Eq  (1)  and  (2).  Ry  substituting  (1)  into  (2),  > (%)  Is 
given  by  Eq  (5) 


NF-1 

. <nl  = r(n  ) - E a 


, (n  ) x in 

0 k”  k ° ° 


Adaptive  digital  filters  have  been  investigated  for  a 
variety  of  applications,  especially  in  the  area  of  signal  proc- 
essing. The  adaptive  transversal  (nonrecurslve)  filter  is 
well  known  in  this  area  [4,51.  Adaptive  recursive  filters 
have  also  been  investigated  (l,3). 

The  stability  of  adaptive  filters  Is  of  interest  to  those  who 
intend  to  use  them.  The  stability  of  adaptive  recursive  fil- 
ters are  especially  difficult  to  determine  analytically  since 
the  filter  is  nonlinear  and  the  stability  criteria  are  functions 
of  several  quantities. 

The  stability  of  the  adaptive  recursive  filter  defined  by 
Felntuch  [lj  has  been  examined  analytically.  Inequalities 
defining  a triangle  are  derived.  The  derivation  is  simple 
with  a minimum  of  assumptions,  but  it  does  use  a frozen- 
time  viewpoint.  Consequently  the  triangular  area  tends  to  be 
a necessary  but  not  a sufficient  condition  for  stability.  The 
stability  triangle  concept  is  checked  for  one  mode  of  opera- 
tion of  the  adaptive  recursive  filter  by  simulation  of  two 
specific  examples.  The  triangle  predicted  the  stable  region 
with  reasonable  accuracy. 


N1) 

- E bm<no>  ^"o  - m)  (5) 

m^l 

l.o.,  «2(iio)  is  a function  of  present  and  past  inputs,  of  past 
outputs,  and  of  present  weights.  Figure  1 shows  the  error 
squared  for  the  case  of  one  feed  forward  and  one  feedback 
weight.  The  error  squared  is  a parabolic  cylinder.  If 
is  non  zero,  it  can  be  reduced  by  modifying  the 
present  weights,  see  Figure  1.  In  particular,  let  the  weights 
be  modified  proportional  to  the  negative  of  the  first 
derivative. 

»k<no>  = \<n0>  ‘ 5 mF  d,2(no)/dak(no)  (6) 

Bm(no>  * bm(no>  - °* 5 "B  d‘2<“o>/abm<no>  (7) 

Since  changing  agR^)  and  bm<n0>  do  not  affect  rfi^),  xlOp-k), 
nor  yliiy-m)  of  Eq  (5), 

»k(no>  = ak<n0>  * **f  * ‘V  x<Vk>  (8) 


2.  Stability  Triangle 

Felntuch  [lj  defines  the  following  adaptive  recursive 
filter: 

NF-1  NB 

y(n)  = E a.  (n)  x (n-k)  ♦ E b fn)y(n-m)  (1) 

k-  0 m=l 

«<n)  = r(n)  - y(n)  (2) 

ak(n*l)  - ak(n>  ♦ pF  <(n)  x (n-k)  (3) 

bm(n«l)  * bm(n)  * Mg  • (“)  y<n-n>)  H) 

where  n is  the  Iteration  number,  x(n)  la  the  input,  r(n)  is  a 
reference  quantity,  <(n)  Is  the  error  In  the  output,  agRi)  and 
bm(n)  are  the  adapting  feed  forward  and  feedback  weights, 
and  My  and  fig  are  the  feed  forward  and  feedback  gain 
constants. 


b (n  ) = b (n  ) • ji  >(n  ) y(n  -ml 
m'  o m'  o B o o ' 


The  stability  criteria  will  be  derived  by  considering  one 
Instant  of  time  rather  than  the  normal  approach  of  taking  a 
limit  as  the  number  of  iterations  becomes  very  large.  The 


This  work  was  performed  on  the  Sonar  1H&D  Program 
funded  by  the  Marine  Systems  Division. 


Two  observations  are  to  be  made.  First,  ak(n0)  and 
Bm(nD)  can  be  used  as  initial  estimates  for  agl^t  1)  and 
bmino*1)>  respectively.  Repeating  this  process  for  each 
value  of  n results  in  Kq  (3)  and  (4).  This  can  be  considered 
as  another  derivation  of  Ka  (3)  and  (4)  since  the  derivation 
differs  from  that  given  In  [lj. 


1 


The  aoi'ond  olmervutlon  Is  that  the  values  o(  pp  and  Mi) 
must  lb?  constrained  to  111?  within  cortaln  bounds  If  * (*V>)  *B 
to  Ik-  reduced  by  using  ag(n„)  anil  i>m(nn)-  1-ot  r2<no>  donotc 
the  val tie  of  the  error  aqua  red  w hen  using  the  modified 
weights,  and  let  i2(n<,)  denote  lUt  value  when  using  the  un- 
modified initial  weights.  One  wants 


* 2<no)  < <2(no) 

Rewriting  Eq  (5)  using  ag  and  b and  then  substituting 
Eq  (H)  anil  (9)  for  their  values  gives 


(10) 


NK-1  NH 

1 - Mf  X)  x2(no-k)  - pfJ  XI  y2(no-"»)  J (H) 


It  follows  that 
NF-1 


NB 


Oi  p XI  x2(n  -k)  * p XI  y2<n0-m)<  2 <12> 

k=  0 m=  1 


is  equivalent  to  Inequality  (10). 

This  is  the  main  stability  criterion,  and  several 
observations  will  be  made  about  it.  To  simplify  the  notation, 
define  l(n)  as 


NF-1  NB 

l'(n)  = p.,  XI  x2(n-k)  ♦ p.  £1  y2(n-m)  <l3> 

* k-0  m=  1 


The  derivation  of  Inequality  (12)  does  not  specify  the 
nature  of  the  inputs  and  outputs,  e.g. , deterministic  and/or 
statistical,  and  hence  should  apply  to  both..  Furthermore, 
the  mode  of  operation  Is  not  upeclfled,  e.g. , signal  enhance 
or  Interference  cancel,  and  hence  should  apply  to  all  of  them 

Two  check  points  exist  on  the  stability  criterion.  If  NB 
is  zero,  Eq  (»).  (2)  and  (3)  become  the  well  known  (non 
recursive)  adaptive  transversal  filter.  Inequality  (12) 
becomes 


NF-1 

0 < tiy  ' x2(n-k)  < 2 (14) 

k-0 

which  coincides  with  a sufficient  stability  criterion  of  the 
tramversa)  filter  It).  Also,  If  x(n)  and  r(n)  are  zero  for 
n >n<  - NF,  then  the  filter  Is  recursive  only  and  goes  Into 
a turn  off  state  if  stable.  A sufficient  condition  for  y(n)  to 
converge  to  zero  for  this  situation  is  given  In  [2],  namely  If 

NB 

£bm<»l>*Y<ifB  <15> 


and  If 

0 4 PB  NB  Max  { yZ<nr  - m)  |m  - 1,2,... , NB)  s 2 (16) 

This  is  reasonably  consistent  with 
NB 

0 < p.  EyVm)<2  (17) 

H m- 1 

Inequality  (12)  requires  either  ny  or  pg  be  positive,  but 
does  not  require  both  to  lie  positive.  It  Is  common  practice 
to  set  the  outputs  and  the  weights  to  zero  as  Initial  values 
for  the  adaptive  filter.  Under  this  Initialization  process, 

I"(n)  Is  dominated  for  the  first  few  Iterations  by  pp  Ix2(n-k) 


and  p..  must  be  positive  If  l'(n)  Isto  be  positive.  If  Pgts  nega- 
tive, then  the  lower  and  upper  bound  on  I'(n)  can  be  exceeded, 
but  If  pc  and  pg  are  both  positive,  then  the  lower  bound  on 
I'(n)  la  Inherently  satisfied.  For  these  reasons  the 
constraints 


> 0 

(18) 

> 0 

(19) 

will  be  added.  Inequalities  (12),  (18)  and  (19)  define  a 
triangle  In  the  (py,  pg)  plane,  and  this  triangle  will  be 
denoted  the  stability  triangle. 

The  above  derivation  of  the  stability  criterion  (12)  does 
not  require  the  gains  pF  and  pg  to  be  constant.  They  need 
only  to  be  Independent  of  the  weights.  They  may  be  functions 
of  the  Iteration  n and  Indices  k and  m.  The  general  stability 
criterion  would  then  be 

NF-1  NB 

0<  XI  . (n) x2  (n-k)  + JIp.,  _(n)y2  (n-m)  < 2 (20) 

k=0  * * * m=l 

In  summary,  a general  stability  triangle  has  been 
derived.  Modifying  the  weights  using  values  of  pp  and  pg 
from  this  triangle  will  reduce  the  present  error.  One  could 
expect  this  triangular  area  to  be  correlated  with  the  true 
stability  region  of  a given  application. 

3.  Application  to  the  Coefficient  Evaluation  Mode 

The  stability  triangle  uses  the  philosophy  that  If  the 
present  error  is  reduced  the  stability  of  the  filter  Is  enhanced. 
It  seems  reasonable,  but  verification  Is  left  to  a computer 
simulation  solving  Eq  (1)  - (4)  for  the  transient  response  of  a 
given  situation. 

The  filter  can  be  used  In  several  modes  of  operation: 
signal  enhancing,  interference  cancelling,  coefficient  evalu- 
ation, etc.  To  test  the  theory,  two  test  cases  were  chosen 
from  the  coefficient  evaluation  mode,  see  Figure  2.  The 
unknown  fixed  filter  Is  a transversal  or  recursive  Biter  with 
fixed  weights  whose  values  are  unknown. 


Figure  2.  Coefficient  Evaluation  Mode 

This  mode  of  operation  was  chosen  as  It  has  several 
advantages  for  the  test  to  be  performed.  If  the  adaptive 
filter  Is  at  least  as  long  as  the  fixed  filter  with  respect  to  NF 
and  NB,  the  adaptive  filter  error  squared  will  converge  to 
zero  If  stable.  This  allows  a simple  accurate  numerical  test 
for  stability . Also  by  keeping  the  filter  lengths  short,  the 
amount  of  computation  was  minimized. 


The  white  noise  generator  was  Gaussian,  mean  zero  and 
variance  of  one.  At  the  start  of  each  run  the  adaptive  filter 
was  reset  to  zero.  Stability  was  defined  by 


cl.OxlO'30  stable 
>1.0  xlO*3®  unstable 


(21) 


S 


Iteration  was  continued  until  one  of  the  two  states  was  reached 
for  some  value  of  n.  Since  «(n)  appears  in  the  weight  update 
equations,  it  was  assumed  that  further  iterations  would  not 
reverse  the  result  and  the  run  was  terminated.  After 
monitoring  the  transient  response  of  <2(n)  on  many  runs,  it 
is  believed  that  the  approach  was  adequate. 

The  two  cases  considered  were 


The  average  stability  triangle  was  determined  in  the 
following  manner.  I'  of  Eq  (13)  varies  from  iteration  to 
Iteration.  In  order  to  get  some  average  triangle,  it  was 
assumed  that 

NF-1 

NF  o2  = £ x2(n-k) 


Case  I:  r(n)  - 0.0273  x(n)  -0.0371  x(n-l) 

* 0.  0252  x(n-2)  *0.  8926  r(n-l) 
-0.3984  r(n-2) 


NB 

y2(n-m) 

“ m-1 


Case  11:  r(n)  = x(n-2)  (23) 

For  both  cases,  NF  - S and  NB  - 4 for  the  adaptive  filter. 
Several  thousand  Monte  Carlo  runs  were  made  for  each  case. 
The  results  are  shown  in  Figures  3 and  4 by  contours  of 
10  percent,  50  percent  and  90  percent  probability  of  being 
stable.  These  contours  are  density  functions.  A (pp,  pB) 
point  picked  from  the  10  percent  contour  will  on  the  average 
result  in  the  adaptive  filter  being  stable  10  times  out  of  every 
100  Monte  Carlo  runs. 


.10%  STABLE 


o.i  — 


.•0%  STABLE 


0 100  200  MO  400 


Figure  3.  Stability  Diagram  for  Case  I 


T ipF  NFo2  NB  ®2  (26) 

The  variance  of  x(n)  is  known  to  be  unity  from  the  white  noise 
generator.  If  thB  filter  is  stable, 

02  = 02  (27) 

y r ' 

near  convergence.  Driving  the  fixed  filter  by  the  white  noise 
gave  a measured  oj  of  0.001  (analytical  resists  not  normally 
available  gave  0.001015)  for  case  I,  and  for  case  II,  o*  - <r£. 
Thus 

r = 5 Pp  + 0.004  PB  Case  I (28) 

r = 5 p„  * 4 p Case  II  (29) 

J MJ 

The  lines  for  r = 1 and  T=  2 are  shown  on  Figures  3 and  4. 

As  can  be  seen,  the  contours  of  constant  stability  tend 
to  be  parallel  to  a line  of  constant  I'.  With  very  little 
information,  the  stable  region  has  been  predicted  by  the 
average  stability  triangle  with  reasonable  accuracy. 

There  are  "edge"  effects  in  the  contour  lines  near  the 
pp  and  pp  axes.  These  effects  are  not  explained  by  the 
stability  triangle  theory . 

A variety  of  (pp,  pB)  values  were  tried.  Whenever 
T > 2,  or  Pp  < 0,  or  pB  < 0 the  adaptive  filter  was  unstable. 

If  NF  and  NB  has  been  larger  (smaller),  then  according 
to  the  stability  criterion  (12)  the  stable  region  would  be 
smaller  (larger)  and  the  probability  of  a given  (pp,  pB) 
point  being  stable  would  decrease  (Increase).  A spot  check 
indicated  this  was  true  when  NF  and  NB  were  made  larger, 
and  it  was  partially  true  when  NF  and  NB  were  made  smaller. 
For  small  NB,  Eq  (25)  la  not  a good  approximation,  and  this 
is  suspected  of  being  the  cause  of  the  limited  agreement. 

Figures  3 and  4 show  that  for  these  two  cases  the  true 
stability  region  is  not  sharply  defined.  It  has  a transition 
region  from  high  to  low  probability  of  being  stable. 

4.  Summary 

A stability  triangle  has  been  derived  analytically  on 
fundamental  principles.  It  is  expected  that  there  would  be 
a correlation  between  an  average  stability  triangle  and  the 
true  stability  region.  The  theory  should  be  applicable 
whenever  an  average  triangle  can  be  determined.  Computer 
simulations  of  two  cases  in  the  coefficient  evaluation  mode 
showed  that  it  did  apply  there. 
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